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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 
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Agenda  Overview 


•  Welcome  and  Introductions 

•  Update  on  IDQTF  Optimization  of  UFP- 
QAPP 

•  Update  on  G-5a 

•  Quick  Update  on  IDQTF  Training 


IDQTF  QAPP  Opt.  Overview 


•  IDQTF  background 

•  Objectives 

•  Goals  and  Schedule 

•  Review  of  draft  products 

•  Current  Optimization  Status 

•  Coordination  with  EPA  G-5a 

•  Path  forward/questions 


IDQTF 


•  IDQTF:  Intergovernmental  Data  Quality 
Task  Force 

•  Members:  EPA,  DoD,  DOE 

•  Contributors:  State  Regulators  & 
Contract  Support 

•  March  2005  -  UFP-QAPP  Manual  first 
published 

•  June  2010  -  UFP-QAPP  Optimization 
subgroup 


r  Objectives 

Optimize  the  UFP-QAPP  Worksheets  by: 

•  Eliminate  Redundancy 

•  Increase  Ease-of-Use 

•  Promote  Systematic  Planning 

•  Institute  Lessons  Learned 

•  Provide  Better  Instruction 

•  Promote  Consistency 

•  Reinforce  the  graded  approach 


Disclaimers 


•  These  are  draft  products  and  have  not 
been  approved  by  the  main  IDQTF 
body. 

•  The  optimization  effort  is  still  a  work  in 
progress. 


Optimized  Worksheets 


•  Worksheet  1  &  2 

•  Worksheet  3  &  5 

•  Worksheet  4,  7,  &  8 

•  Worksheet  9 

•  Worksheet  10 

•  Worksheet  1 1 

•  Worksheet  12 

•  Worksheet  13 

•  Worksheet  1 4  &  1 6 

•  Worksheet  15 


•  Worksheet  17 

•  Worksheet  18 

•  Worksheet  20 

•  Worksheet  21 

•  Worksheet  22 

•  Worksheet  24 

•  Worksheet  25 

•  Worksheet  26  &  27 
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ptimized  Worksheets  w/o  Significant  Changes 


•  Worksheet  10:  Now  specifically  dedicated  to  the  CSM 

•  Worksheet  11:  Remaining  steps  of  PQO’s/SPP 

•  Worksheet  17:  Sampling  Design  (Document  rationale!) 

•  Worksheet  20:  Field  QC  -  minor  changes  to  fields 

•  Worksheet  21 :  Field  SOPs 

•  Worksheet  22:  Field  equipment  -  Some  entries  can  be 
referenced  to  WS21  to  avoid  redundancy 

•  Worksheet  24:  Analytical  Cal  table  -  Ref.  SOPs  where 
appropriate  to  avoid  redundancy 

All  worksheets  have  additional  instruction  (green-text)  that 
also  explains  the  purpose/value  of  the  elements.  The 
green-text  would  be  removed  in  the  final  QAPP. 


QAPP  Worksheet  #1/2 
Title  and  Approval  Page 
(UFP-QAPP  Section  2.1) 
(EPA  QA/G-5  Section  2.1.1) 


This  worksheet  identifies  the  principal  points  of  contact  for  all  organizations  having  an  interest  in  the  project  and 

E  What  has  Changed? 

•  Additional  Instruction 

1  •  Combined  worksheets 

•  Approval  signatures  are  Mandatory 

2  •  Redundant  information  removed 

s  •  Cross-walk  table  can  be  added  if  necessary 


5.  Federal  Regulatory  Agency  (name/title/signature/date) 

6.  State  Regulatory  Agency  (name/title/signature/date)) 

7.  Other  Stakeholders  (as  necessary) 
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List  plans  and  reports  from  previous  investigations  relevant  to  this  project 


QAPP  Worksheet  #3&5:  Project  Organizational  Chart  &  QAPP  Distribution 

Provide  a  project  organization  chart  identifying  key  personnel  for  the  client  (or  lead  agency),  prune  contractor,  all  subcontractors,  and  regulatory  agencies.  Two 
examples  are  provided  below.  Examples  should  be  modified  as  necessary  to  suit  the  project. 

Identify  reporting  relationships  between  all  organizations.  Charts  should  include  lmes  of  responsibility  (shown  below  as  solid  lines),  lines  of  communication 
(shown  below  as  dotted  lmes).  and  phone  numbers.  For  the  purpose  of  the  draft  QAPP,  it  is  permissible  to  show  "TBD"  m  cases  where  roles  have  not  been 
assigned,  but  relationships  between  organizations  and  organizational  roles  should  be  noted.  All  key  personnel  must  be  identified  in  the  final,  approved  QAPP. 

For  the  purpose  of  document  control,  this  worksheet  should  also  be  used  to  document  recipients  of  controlled  copies  of  the  QAPP.  The  draft  QAPP.  final  QAPP. 
and  any  changes/revisions  must  be  provided  to  all  QAPP  recipients  shown  on  this  chart.  Use  astensks  or  other  symbol  to  designate  QAPP  recipients.  Contractors 
and  subcontractors  shown  on  this  chart  are  responsible  for  document  control  within  their  organizations. 


*  QAPP  Recipient  Lines  of  Authority  -  Lines  of  Communication 


j  •  Additional  Instruction 
[  •  Combined  worksheets 

•  Visual  identification  of  distribution, 
communication  &  organizational  information 

•  Consistency  with  WS  4,  7,  &  8 


[Name.  Contact 

[iName.  a  omaci 
Info] 

Infol 

QAPP  Worksheet  #4, 7,  &  8:  Personnel  Qualifications  and  Sign-off  Sheet 

(UFP-QAPP  Manual  Sections  2.3.2,  2.4.3  and  2.4.4) 

This  worksheet  is  used  to  identify  key  project  personnel  for  each  organization  performing  tasks  defined  in  this  QAPP.  In  this  example  organizations  include  the 
prune  contractor  and  laboratory.  Add  other  organizations  as  necessary.  This  worksheet  hsts  individuals’  project  titles  or  roles:  qualifications:  and  any 
specialized  non-routine  training,  certifications,  or  clearances  required  by  the  project,  e  g.  explosives  and  ordnance  disposal  (EOD)  technician.  Professional 
Engineer.  Certified  Professional  Geologist,  etc.  Add  spaces  as  necessary.  [Note:  HAZWOPER  traimng  is  not  considered  specialized  training  ] 

ORGANIZATION  Prime  Contractor _ 

What  has  Changed? 

_  •  Additional  Instruction/clarification 
—  •  Combined  worksheets 
=  •  General  Identification  of  qualifications  & 
training  categorized  by  organizations 


Name 

Project  Title  Role 

EducationExperience 

Specialized 

Training/Certification 

Location  of  Training 
Records/Certificates 

Signature  Date* 

QAPP  Worksheet  #9 
Project  Planning  Session  Summary 
(UFP-QAPP  Manual  Section  2.5.1,  and  Figures  9-12) 
(EPA  QA/G-5  Section) 


ijjwhat  has 
|  •  Project  F 
z  •  Addition; 

noi 

■>.  •  Key  deci 

Loi  J 

Pu 

Pa 

Name 

Changed? 

banning 
al  Instructior 
sion  items  \ 

Organization 

1 

lighlighted 

Title/Role 

Email/ Phone 

'e 

fi  nd 

o  suit 

Notes/Comments: 
Consensus  decisions  made: 


Action  Items: 


Action 

Responsible  Party 

Due  Date 

QAPP  Worksheet  #12 
Measurement  Performance  Criteria 
(UFP-QAPP  Section  2.6.2) 

(EPA  QA/G-5  Section  _) 


What  has  Changed? 

separated  •  Better  Instructions 

•  SOP  fields  removed  due  to  redundancy 
Matir  •  “Type  of  error”  field  removed 

Analytical 

Concentra 


Data  Quality  Indicator  (DQI) 

QC  sample  or  measurement 
performance  activity 

Measurement  Performance  Criteria 

Overall  Precision 

Field  Duplicates 

RPD  <  30%  when  VOCs  are  detected  in  both  samples  >  LOQ 

Analytical  Precision 
(laboratory) 

Laboratory  Control  Sample  Duplicates 

RPD <  25% 

Analytical  Accuracy/Bias 
(laboratory) 

Laboratory  Control  Samples 

Analyte-specific  (See  Worksheet  12A) 

Analytical  Accuracy/Bias 
(matrix  interference) 

Matrix  Spike  Duplicates 

Analyte-specific  (See  Worksheet  12A) 

Overall  accuracy/bias 
(contamination) 

Equipment  Blanks 

No  target  analyte  concentrations  >  LOQ 

Sensitivity 

LOQ  verification  sample  (spiked  at  LOQ) 

Recovery  within  ±25%  of  LOQ 
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QAPP  Worksheet  #13 
Secondary  Data  Uses  and  Limitations 
(UFP-QAPP  Section  2.7) 

What  has  Changed? 

•  Better  Instructions 

•  “Generator”  field  removed  due  to  redundancy 

ensi  J  g 

•  Note  that  there  is  a  difference  between 
secondary  data  and  secondary  use  of  data 

the  comparability  ot  data  collection  methods  to  the  currently  proposed  methods. 


Data  type 

Source 

Data  uses 

Factors  affecting  the  reliability  of  data  and 
limitations  on  data  use 
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QAPP  Worksheet  #14/16 


What  has  Changed? 

•  Better  Instructions 

•  Combined  worksheets 

•  This  information  may  also  be  available  & 
referenced  in  other  documentation 


Activity 

Responsible  party 

Planned  start  date 

Planned  completion 
date 

Deliverable(s) 

Deliverable  due  date 
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Our  action  level  is 
one  mammoth,  but 
I  can  detect  a  lot 

lower  than  that . I 

think. 


I  wonder  if  that 
thing  is  calibrated? 


Early  Detection  Limit  Issues 


Detection  Limits 


“The  analytical  data  objective  for  baseline  risk 
assessments  is  that  the  uncertainty  is  known  and 
acceptable,  not  that  the  uncertainty  be  reduced  to  a 
particular  level.  ” 

“Whenever  possible,  methods  should  not  be  used  if 
the  detection  limits  are  above  the  relevant 
concentrations  of  concern.  The  MDL  should  be  no 
greater  than  20%  of  the  concentration  of  concern.  ” 

“To  protect  human  health,  place  a  higher  priority  on 
preventing  false  negatives  in  sampling  and  analysis 
than  on  preventing  false  positives.  ” 

-  Guidance  for  Data  Usability  in  Risk  Assessment,  EPA  Office  of  Emergency  and 
Remedial  Response,  April  1992. 
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Detection  Limits,  Cont. 


NCP  40  CFR  300.430(e)(2)(i):  “Remediation 
goals  shall  be  developed  considering... 
technical  limitations  such  as  detection/ 
quantification  limits...” 

RAGs,  Part  A,  section  5.3.4  ‘‘...SQLs  are  the 
most  appropriate  limits  to  consider  when 
evaluating  non-detected  chemicals.  ” 

“...  reported  concentration  (i.e.,  data  that  are 
not  "tentative,”  “ uncertain ,” or  “ qualitative ”) 
are  appropriate  for  use  in  the  quantitative  risk 
assessment. 
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QAPP  Worksheet  #15 

Project  Action  Limits  and  laboratory-specific  detection/ quantitation  limits 

(UFP-QAPP  Section] 

[EPA  QA/G-5  Section] 

What  has  Changed? 

•  Better  Instructions 

•  Do  not  use  MDL  as  PAL 

•  LOD  may  be  added  for  DoD  projects 

•  Lab  DL  and  LOQ  fields  populated  after 
procurement 


Analyte 

Project  Action 
Limit 

Reference 
(regulatory  limit) 

Project 

Quantitation  Limit 
Goal 

Method 

Laboratory- 
specific  LOQ 

Laboratory- 
specific  DL 

QAPP  Worksheet  #18 
Sampling  Locations  and  Methods 
{UFP-QAPP  Section  3.1.1  and  3.1.2) 

(EPA  QA/G-5  Section  2.2.2) 

What  has  Changed? 

•  Some  fields  removed  due  to  redundancy 

•  Completeness  check  for  field 

•  Intended  entries  for  each  sample  but  global 
entries  can  be  used  for  large  projects 


•  QC-related  samples  MUST  have  separate 
entries 


- r  -  — 

"  *1 —  v~ - / 

■  ir” 

•  — / - - r 

— r....Q  — 

— . — 

CHS-GW-VOC-OOl 

GW 

20-30 

Grab 

VOCs 

TECH-025 

CHS-GW-VOC-OOID 

GW 

20-30 

Duplicate 

VOCs 

K 
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What  has  Changed? 

•  Some  or  all  fields  may  be  referenced  to  the 
lab’s  quality  system 


Instrument  1 
Equipment 

Maintenance 

Activity 

Testing 

Activity 

Inspection 

Activity 

Frequency 

Acceptance 

Criteria 

Corrective 

Action 

Responsible 

Person 

Reference 
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UFP-QAPP  Worksheet  #26/27:  Sample  Handling,  Custody,  and  Disposal 


What  has  Changed? 

•  Combined  worksheets 

•  Eliminated  redundancies 


SAMPLE  LABELING.  PACKAGING.  AND 

SHIPPING 

PERSONNEL  AND  ORGANIZATION 

DESCRIPTION  OF  ACTIVITY  OR 

SOP  REFERENCE 

Sample  Labeling 

Chain-of-Custody  Form  Completion 

Packaging 

Shipping  Coordinator 

Shipper/ earner : 

SAMPLE  RECEIPT.  STORAGE  and 

DISPOSAL 

Sample  Receipt.  Inspection,  and  Log-in 

Sample  Custody  and  Storage 

Sample  Disposal 

No.  of  days  from  reporting  to  disposal: 
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Worksheet  23,  28 

Worksheet  19,  29,  30 

Worksheet  31 ,  32,  33 

Worksheet  34,  35 

Worksheet  36,  37 

Face-to-face  meeting  to 
finalize  all  worksheets 


April  2011 
May  201 1 
June  2011 
July  2011 
August  2011 
Fall  2011 


Beg  n  Optimization  of 
UFP-QAPP  Manual 

90909 


Winter  2011 
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True/False 


•  Systematic  planning  and  the  UFP-QAPP 
takes  more  time  and  money  than  previous 
QAPP  development  processes. 

False!  UFP-QAPP  is  a  team-based  effort  and 
does  require  additional  planning  and 
coordinated  decision-making.  However, 
overall  savings  are  being  realized  in 
preventing  re-work  through  higher  confidence 
and  documentation  in  decisions. 
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True/False 


•  Do  the  RPMs  really  need  to  be  involved  with 
confusing  topics  like  detection  limits,  data 
usability,  and  analytical  method  selection? 

YES!  RPMs  should  have  a  working  knowledge 
of  issues  that  affect  decision-making  but  still 
rely  on  their  technical  support  staff.  The 
IDQTF  does  recognize  that  we  need  to  identify 
the  needs  of  the  RPM’s  and  assist  project 
teams  with  appropriate  training  on  some  of 
these  issues. 
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True/False 


•  So  technical  support  staff  need  to  be 
present  during  project  planning 
sessions? 

FALSE!  RPMs  should  decide  upon  the 
need  and  extent  of  technical  support.  In 
addition,  planning  can  be  done 
internally/externally  and  can  be  done  by 
phone  or  e-mail.  But,  it  is  important  to 
involve  them  early  in  the  planning  steps. 
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True/False 


•  The  UFP-QAPP  is  too  structured/rigid  and 
limits  the  project  team’s  ability  to  be  flexible. 

FALSE!  That  is  NOT  the  intent  of  the  UFP- 
QAPP.  The  graded  approach  is  emphasized 
throughout  the  UFP-QAPP.  The  RPM’s  are 
still  the  decision-makers  and  they  decide 
upon  sampling  design,  data  usability,  etc. 
However,  the  UFP-QAPP  does  require  that  the 
rationale  be  documented. 
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